Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Define data models for LLM interactions #4

Open
wants to merge 12 commits into
base: dev
Choose a base branch
from

Conversation

NeonDaniel
Copy link
Member

@NeonDaniel NeonDaniel commented Nov 15, 2024

Description

Add llm module
Defines LLMPersona from backend implementation
Defines LLMRequest based on HANA and BrainForge implementations
Definces MQ API for LLM interactions

Issues

Other Notes

This is compatible with the current implementation in HANA, but it will reformat requests st history follows the OpenAI format
This implements some logic in the BrainForge webapp demo, adding some validation of parameters
This includes some refactoring of module init to resolve circular import/partial-init errors

Defines LLMPersona from backend implementation
Defines LLMRequest based on HANA and BrainForge implementations
Define `llm.__all__` and add submodule-level import for consistency
Add support for arbitrary `role` values in `to_completion_kwargs`
Add `MqLlmRequest` model with test coverage
Update LLMPersona to be compatible with model in `neon-llm-core`
Refactor `MqLlmRequest` to `LLMProposeRequest` to be consistent with Chatbotsforum terminology
@NeonDaniel NeonDaniel marked this pull request as ready for review November 23, 2024 00:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant